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FINAL  TECHNICAL  REPORT 
GRANT  #:  NOOOl  4-02- 1  -0280 

PRINCIPAL  INVESTIGATORS :  Dr.  Keith  Womer  (e-mail:  l<womer@bus.olemiss.edu) 

Dr.  Jeff  Camm  (e-mail:  ieff.camm@,uc.edu  ) 

INSTITUTION:  University  of  Mississippi 

GRANT  TITLE:  Estimating  Models  of  Program  Management 

AWARD  PERIOD:  1  February  2002  -  30  September  2003 


OBJECTIVE: 

To  investigate  approaches  to  dynamically  generating  cost-minimizing  production  plans  in  the  made-to- 
order  production  scenario  tiiat  is  typical  of  defense  contracting. 

APPROACH: 

In  order  to  make  production  decisions  to  minimize  the  present  value  of  expected  cost  while  maintaining 
delivery  schedules,  we  must  be  able  to  realistically  model  and  estimate  the  relationship  between 
production  and  cost.  We  are  particularly  interested  in  estiihating  parameters  that  determine  returns  to 
the  variable  factors  and  learning.  Returns  to  the  variable  factors  in  a  production  situation  refers  to  the 
tendency  of  the  cost  per  unit  to  vary  with  the  production  rate.  Typically  cost  increases  at  an  increasing 
rate  wi&  the  production  rate,  at  least  beyond  some  threshold  rate.  Learning  refers  to  the  cost  savings 
gained  from  experience  with  the  production  process,  with  costs  typically  decreasing  at  a  decreasing  rate 
with  cumulative  production.  These  factors  clearly  affect  the  relationship  between  production  level  and 
cost. 

»» 

It  is  important  to  estimate  these  parameters  early  enough  in  the  production  program  to  adjust  the 
production  schedule  in  anticipation  of  the  pronounced  effects  of  these  factors.  The  production  of  a 
made-to-order  product  is  often  a  non-recurring  production  process.  As  a  result,  the  lack  of  prior 
experience  creates  a  difficult  problem  for  those  interested  in  planning  die  production  of  the  new  product. 
While  cost  estimating  relations  and  experience  on  prior  programs  may  provide  some  guidance,  prior 
production  planning  in  this  situation  is  uncertain  at  best  without  usefiil  estimates  for  parameters  of  the 
production  environment.  But,  waiting  imtil  there  is  enough  data  available  from  current  production  to 
make  use  of  classical  statistical  estimation  techniques  may  give  results,  but  they  are  likely  to  be  too  late 
to  be  of  practical  use.  This  apparent  dilemma  eliminates  the  possibility  of  decision  support  from 
classical  tools. 

A  nonlinear  deterministic  model  is  extended  tiirough  the  use  of  a  bayesian  updating  scheme.  Initial 
inputs  for  die  parameters  of  the  model  are  used  to  generate  a  cost-minimizing  production  schedule.  The 
deterministic  model  and  its  parameters  are  defined  as  follows: 
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^  Decision  Variables: 

Xt=  resources  needed  in  time  period  t 
,  qt  =  production  rate  in  time  period  t 

Qt  =  cumulative  production  for  learning  for  period  t  production 
Parameters: 

y  =  returns  to  variable  factors  parameter 
6  =  learning  parameter 

p  =  discoimt  rate  (assume  discounting  at  the  start  of  the  period) 
V  =  total  volume  required  by  the  contract 
T  =  ending  period  of  the  contract 
B  =  a  scale  parameter 


Minimize 

E  x,(i/(i+p)y-‘ 

t=I 

(1) 

subject  to: 

lt,=Bq;Qr‘ 

t=l,2,...T 

(2) 

Qi  ~  ^1^2 

(3) 

Q.=2qk+(q/2) 

k=l 

t=2,...T 

(4) 

T 

i:q.  =  v 

t-1 

(5) 

x,,q,,Q,>0 

t=l,2,...T 

(6) 

The  objective  function  (1)  minimizes  the  total  discounted  cost  of  resources  used  throughout  the  life  of 
the  program.  Constraint  set  (2)  defines  resources  used  in  a  Cobb-Douglas  type  production  fimction 
where  resources  are  a  function  of  current  production  rate  and  previous  production  experience. 
Constraints  (3)  and  (4)  define  cumulative  production  (giving  credit  for  half  of  the  production  in  the 
current  period.  Constraint  (5)  requires  that  V  units  be  produced  in  the  T  time  periods  of  the  program. 
Finally,  (6)  ensures  non-negativity  of  the  decision  variables. 

Through  substitution  and  the  use  of  an  approximation  for  total  resources  utilized  in  period  t,  the  problem 
may  be  written: 


i-<y 

subject  to: 

T 

Eq.  =  V 


(7) 

(8) 


Q,>0 

t=l,2,...T 

(9) 

Qo=0 

(10) 
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'  Given  a  discrete  joint  probability  distribution  for  y,  5,  and  p,  denoted  p(y,  6,  p),  the  problem  of 

minimizing  discounted  cost  is  given  by: 


MinC=i:  ZB 

i=l  M 

subject  to: 


_ 

i 

1 

_ 1 

li+pj 

PiViA’Pi) 


Zqt=V 


Q,^0  t=l,2,...T 

Qo=0 


(11) 

(12) 

(13) 

(14) 


Here,  N  is  the  number  of  discrete  points  of  the  joint  distribution.  The  model  (1 1)-(14)  is  utilized  to  plan 
the  program  so  as  to  meet  production  requirements  and  minimize  expected  cost.  We  use  this  model 
dynamically  over  time  to  optimize  the  program  given  a  new  updated  posterior  distribution  of  the 
parameters.  This  updating  scheme  is  conducted  as  follows: 

We  cast  returns  to  the  variable  inputs  and  learning  parameters  as  y  and  S ,  respectively.  They  relate 
cost  )  in  period  k  to  current  and  cumulative  production  in  our  model  according  to  the  following 
equation  (  Note  that  here  we  use  undiscounted  cost  since  that  is  what  is  observed.): 


\-S 


(15) 


In  each  period,  an  observation  on  production  cost  is  taken  to  update  the  model  parameters.  The 
parameters  of  are  estimated  with  the  relatioriship:  *• 


ACWPj^^Cj^xSj^  (16) 

where,  ACWP^  is  an  observation  of  the  actual  cost  of  work  performed,  s  is  assumed  to  be  log- 

normally  distributed  with  a  mean  of  1.  The  g^-vector  is  predicted  from  the  probability  distribution  of  the 
parameters  and  optimization  based  on  information  prior  to  the  current  observation.  It  should  be  noted 
that  a  classical  approach  would  assume  that  the  model  parameters  are  fixed  but  simply  unknown.  In 
contrast,  the  Bayesian  approach  assumes  that  the  unknown  parameters  are  random  variables,  each  with 
its  own  distribution.  An  immediate  consequence  is  that  the  output  of  our  analysis  is  a  probability 
distribution  rather  than  a  point  estimate. 


The  Bayesian  updating  process  is  described  by: 


Posterior^  (B,  a,  8,  y)  =  Pr  {B,  a,S,y)* 


(17) 
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(18) 


ACWP. 
z.  = — £ 


where  o-  is  the  standard  deviation  of  the  error  term.  The  term  z*  is  a  ratio  rather  than  a  difference  of  the 

observation  on  cost  for  period  ^  and  Q,  due  to  the  fact  that  we  have  opted  for  a  multiplicative 
lognormal  distributed  error  term  in  the  estimating  relationship. 


ACCOMPLISHMENTS  (throughout  award  period): 

pie  optimization  modeling  and  Bayesian  updating  procedure  previously  discussed  were  developed 
dunng  the  aw»d  period.  Additionally,  computer  programs  were  written  to  perform  these 
wmput^onally  intensive  tasks.  Neither  the  optimization  nor  the  Bayesian  updating  is  computationally 

(n)-(14)  was  constructed  in  Microsoft  Excel  combining  Excel  Solver 
wdi  Visual  Basic  for  Applications.  A  barrier  method  was  utilized  when  the  Solver  occasionally  returned 
infeasible  solutions  (due  to  the  discrete  nature  of  the  algorithm). 

The  Bayesian  updating  scheme  is  computationally  intensive  for  realistic  sized  problems.  Until  recently 
calculation  of  the  posterior  joint  density  function  was  not  a  reasonable  task  due  to  the  tremendous 

processing  power  required.  To  preyent  the  posterior  function  from  growing  unmanageably  complex  it 

is  ^ored  as  a  precise  tensor  of  probabilities.  To  accurately  represent  a  joint  density  function  in  a  tensor 
portions  of  Ae  function,  or  specified  ranges  for  each  unknown,  are  numerically  integrated  with  the  goal 
of  fining  &e  probability  of  each  of  the  yariables  falling  within  the  specified  ranges.  Sufficient 
resolution  of  Ae  ranges  gives  a  satisfactorily  close  and  maintainable  representation  of  the  posterior  ioint 

density  for  the  unknowns.  Therefore,  updating  the  posterior  involves  a  tremendous  exercise  of 
numencal  mtegration. 


"^e  state  of  modern  processing  tec^ology  allows  us  to  perform  the  necessary  computation  on  a  PC  but 
&e  number  of  vmables  ^th  which  we  can  deal  remains  severely  limited.  Our  custom  software, 
developed  m  ANSI  C,  calculated  the  4-dimensional  tensor  of  magnitude  100  in  11  minutes  and  54 
secon^  on  a  2.0  GHz  PC  with  512  MB  RAM.  For  efficiency,  the  necessary  magnitude  to  retain  the 
desired  precision  for  each  dimension  was  determined  by  observing  the  sensitivity  of  the  cost  function  to 
changes  m  the  tensor. 


The  jomt  distribution  yielded  by  this  process  permits  the  calculation  of  discounted  expected  program 
cost  given  some  production  schedule.  Since  the  new  distribution  includes  updated  infonnation  about  the 
production  environment,  it  allows  a  more  accurate  calculation  of  the  discounted  program  cost  than 
possible  m  the  previous  period. 

CONCLUSIONS' 

We  have  developed  an  approach  that  combines  nonlinear  optimization  with  Bayesian  updating  for  the 
dynamic  planning  of  made-to-order  production  programs  often  found  in  defense  contracting.  This 
approach  is  new  in  that  previous  approaches  have  used  static  deterministic  optimization  to  plan  the 
pro^am.  The  Bayesian  approach  proves  useful  in  transforming  a  brief  stream  of  observable  data  into 
continually  improvmg  i^ormation  that  can  help  make  quality  production  decisions.  An  additional 
advantage  of  the  Bayesian  approach  is  the  ability  to  make  appropriate  use  of  the  knowledge  and 
experience  of  managers  and  subject  matter  experts.  Managers’  subjective  knowledge  can  be  introduced 
m  a  meanmgful  way  by  developing  a  reasonable  prior  probability  distribution  for  the  model  parameters. 
This  may  considerably  improve  the  quality  of  the  estimates  in  the  first  few  periods.  For  our 
computational  study,  for  the  sake  of  objectivity,  we  chose  an  uninformed  prior  that  is  uniform.  We 
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*  foxjnd  that  the  joint  posterior  distribution  for  the  model  parameters  began  to  take  a  meaningful  shape 
(clearly  identifiable  peak)  after  only  two  monthly  observations  of  cost. 

The  work  conducted  under  this  grant  is  seminal  work  in  the  area  of  dynamic  Bayesian  optimization  for 
made-to-order  production  planning.  Much  work  remains  to  be  done.  First,  the  current  work  still  relies  on 
the  manual  running  of  two  separate  programs  (the  optimization  model  and  the  Bayesian  updating 
model).  To  be  useful  in  the  field,  these  programs  need  to  be  integrated  and  the  computational  efficiency 
needs  to  be  improved.  Second,  more  detailed  microeconomic  models  (for  example,  a  production  line 
model)  combined  with  the  Bayesian  updating  will  be  even  more  useful  to  managers. 

SIGNIFICANCE: 

Our  study  evinces  that  meaningful  and  timely  estimates  can  be  obtained  after  only  a  few  periods  using  a 
Bayesian  approach  to  estimate  unobservable  environment  parameters.  Where  classical  techniques  fail  to 
be  timely,  a  Bayesian  approach  proves  useful  in  transforming  a  brief  stream  of  observable  data  into 
continually  improving  Mormation  that  can  help  make  quality  production  decisions. 

PATENT  INFORMATION: 

No  patents  have  been  filed  fi-om  this  work. 

AWARD  INFORMATION: 

No  awards  were  given. 

PRESENTATON  OF  THIS  WORK  (for  total  award  period): 

This  work  was  presented  as  “Bayesian  Program  Management”  at  the  2nd  Joint  WINFORMS 
Symposium  22  and  23  April  in  Washington,  D.C. 

Several  papers  are  in  preparation. 
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